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SECTION  1.0  INTRODUCTION  AND  SUMMARY 


A problem  of  interest  in  many  different  disciplines  is  that  ol  determining  if  there  is 
a measurable  relationship  (physical  causality)  between  two  or  more  time  series.  In  addition, 
one  would  often  like  to  obtain  a quantitative  meaningful  measure  ol  the  degree  ot  that 
relationship.  This  report  describes  one  possible  measure  of  such  a relationship,  the 
coherence. 

The  most  common  measure  of  such  a relationship  is  the  pairwise  or  multiple  corre- 
lation coefficient.  The  nature  of  the  correlation  coefficient  is  well  documented  and  will  not 
be  discussed  here  other  than  to  note  that  it  is  not  a function  of  frequency  and  may  be 

affected  by  linear  transformations  of  either  of  the  time  series.  j 

The  coherence  function  (magnitude-squared  multiple  or  pairwise  coherence 
function)  is  defined  as  a frequency-dependent  quantity  that  ranges  between  zero  and  one 
(section  2 and  references  2-l>  and  16).  This  coherence  function  is  zero  if  the  Gaussian, 
ergodie  time  series  are  independent  (uncorrelated)  and  equal  to  one  at  any  frequency  where 
there  is  a linear  transformation  between  the  one  or  more  input  time  series  and  the  output 
or  reference  time  series. 

The  situation  of  interest  is  shown  in  figure  1 .1  where  Uj  indicates  the  noise  contami- 
nating the  signal  u(i)  in  the  i1'1  channel.  In  general,  each  transmission  channel  is  composed 
of  linear  and  nonlinear  parts  (figure  1 .2).  The  sum  ot  the  output  ot  the  nonlinear  system 
(usually  a small  part  of  the  total  transmission),  the  measurement  noise,  and  the  background 
noise  is  grouped  into  the  effective  noise  term  Vj(t ) ( figure  1 .3 ). 

We  are  interested  in  detecting  the  presence  of  a common  signal  u(t)  in  two  or  more 
channels.  The  input-output  relationship  indicated  in  figure  1 .3  can  be  written  as 


■\l<tf 

ao 

■gl<Tf 

-v,(t)- 

\:<t) 

/ 

g-(T) 

u(t  - T)dT  + 

v;(  t ) 

_xM(t)_ 

J 

- CO 

_VM(U_ 

or  more  concisely  as 

CO 

\<t)=  j g(T)U  (t  - T)dT  + V(t). 

- CO 


(1.1a) 


(1.1b) 


Note  that  because  of  physical  causality  requirements,  g(r)  is  zero  for  all  r less  than 
zero.  In  fact,  il  will  be  zero  for  all  r less  than  some  positive  time  which  is  the  time  it  takes 
the  signal  to  travel  from  the  source  to  the  sensor. 

I he  true  value  of  the  coherence  between  time  series  is  generally  an  unknown  quan- 
tity. In  fact,  any  measure  of  the  relationship  between  two  or  more  time  series  generally 
must  be  based  on  time  traces  of  those  series.  1 he  functional  relationship  between  the  time 
series  and  the  measure  or  estimate  of  coherence  is  called  a sample  statistic  for  coherence 
(section  5).  I he  assumption  that  any  one  infinite  length  sample  of  each  series  will  be 
enough  to  allow  us  to  estimate  the  coherence  is  made  implicitly.  I Inis  lor  this  report  all 
time  series  are  assumed  to  lie  stationary  and  ergodie  Unfortunately . in  practice,  one  is 
given  only  a finite  amount  of  data  from  each  of  the  time  series.  In  this  ease  the  sample 
statistic  is  a random  variable  distributed  about  the  "true  magnitude-squared  coherence. 

I he  density  function  for  the  sample  statistic  defined  in  section  5 is  described  and  plotted  in 
section  6 of  this  report. 


I 


k 


Based  on  the  density  functions  of  section  6,  receiver  operation  characteristic  (ROC) 
curves  are  also  given  in  section  6.  These  curves  define  the  probability  of  detection  versus 
probability  of  false  alarm  for  a signal  of  a given  true  coherence.  Also  shown  in  this  section 
are  curves  of  probability  of  detection  versus  true  coherence  for  fixed  levels  of  probability 
of  false  alarm. 

In  sections  3 and  4 the  relationship  between  input  signal  to  noise  levels  and  true 
coherence  for  the  two-channel  and  multichannel  eases  are  discussed. 

For  a general  discussion  of  the  concept  of  coherence,  the  reader  is  directed  to 
reference  5 and  sections  2 and  3 of  this  report.  For  a detailed  derivation  of  the  distribution 
of  the  pairwise  and  multiple  coherence  function  discussed  in  section  6 of  this  report,  the 
reader  is  referred  to  reference  7.  The  densities  and  derived  performance  curves  in  section  6 
are  particularly  difficult  to  obtain  for  low  coherence  and  high  values  of  N (number  of 
samples  of  the  time  series),  and  based  on  the  authors’  knowledge  are  not  available  elsewhere 
in  the  literature. 

Thus  the  results  in  this  report  describe  one  approach  to  obtaining  a quantitative 
measure  of  the  degree  of  relationship  between  M-time  series.  This  report  precisely  defines 
the  detection  performance  possible  when  a common  signal  exists  in  M-series  in  the  form  of 
receiver  operating  curves.  The  precise  performance  expected  is  also  given  in  terms  of  proba- 
bility of  detection  versus  true  coherence  for  a number  of  different  probabilities  of  false 
alarm  and  for  various  numbers  of  time  series  M. 

Calculation  of  the  multiple  coherence  between  various  output  signals,  Xj(t), 
x-i(t)  . . . Xj^(t)  allows  the  simultaneous  use  of  data  from  M sensors  and  should  have  several 
advantages  over  using  simply  pairwise  coherence.  First,  it  should  allow  improved  detection 
performance,  i.e..  it  should  be  possible  under  certain  circumstances  to  detect  the  presence  ot 
a mutual  signal  in  all  M channels  when  it  is  not  quite  possible  to  make  such  a detection  using 
any  two  pairs.  Secondly,  it  provides  a natural  way  to  include  additional  sensor  information. 
It  does  not  require  the  addition  of  a large  number  of  new  test  statistics  each  time  a new 
sensor  is  introduced,  a situation  which  may  occur  when  all  possible  pairs  are  separately 
inspected.  Thirdly,  detection  can  occur  using  this  one  statistic  even  when  the  signal-to-noise 
ratio  varies  on  the  individual  channels.  This  would  allow  signal-to-noise  in  one  channel  to  go 
down  while  another  one  came  up.  without  reducing  the  detection  performance  and  without 
changing  to  a new  statistic. 
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F igure  l.l.  One  inpul-or-output  system. 


SECTION  2.0  CROSS-POWER  SPECTRAL  DENSITY  MATRIX 
AND  MULTIPLE  COHERENCE 


Multiple  coherence  can  be  most  easily  defined  in  terms  of  the  cross  spectral  density 


matrix  Sxx(lj),  where 


SXXM  - 


S|  |(u/)  S|  2(oj)  ...  S|^|(w) 

S-lj(ui)  St->(w)  . . . S-l^j(w) 
Sm|(w)Sm2M  ...  SMMM 


If  i is  not  equal  to  j,  Sjj(uj)  represents  the  crosspovver  spectral  density  between  the 


signals  Xj(t)  and  X:(t): 


Sjj(uj>  = SxjXj(^)  “ S*j(uj). 


(2.2a) 


As  indicated  by  equation  2.2,  this  crosspower  spectral  density  is  generally  complex  for  real 
signals  | xf( t ) and  Xj(t)] . If  i does  equal  i.  the  element  Sjj(uj)  represents  the  autopower 
spectral  density  of  the  \th  signal  xTt)  which  is  real  and  positive: 


Sii(‘-)  = SXj(w). 


(2.2b) 


The  crosspower  spectral  density  matrix  is  of  course  equivalent  to  the  crosscorrelation 
matrix.  Either  of  these  together  with  the  means  of  the  M jointly  Gaussian  stationary  process- 
es. x j ( t ),  x s(  t ).  . . . x\j(t).  completely  specifies  the  joint  distribution  function  of  these 
processes. 

Given  M finite  length  time  traces,  there  are  well  known  techniques  for  obtaining 
“sample  estimates”  of  the  cross-  and  autopower  spectral  elements.  These  estimates  are  used 
to  obtain  sample  estimates  for  the  multiple  coherence  between  the  various  time  series. 

The  sample  estimate  for  the  crosspower  spectral  density  matrix  is  a function  of  the  basic 
data  X](t),  xiD).  . . . x^|(t)  over  some  finite  time  record.  It  does  not  require  knowledge  of 
any  of  the  characteristics  of  the  transmission  channels  or  of  the  signal-to-noise  ratios  of  the 
received  signals.  The  meaning  of  multiple  coherence  will  be  discussed  in  terms  of  these 
quantities  in  later  sections  in  an  attempt  to  illuminate  the  subject.  Here,  however,  we  will 
define  multiple  coherence  simply  in  terms  of  the  crosspower  spectral  density  matrix  and 
its  elements. 
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The  multiple  coherence  between  Xj(t)  and  X|(t),  x->(t),  . . . Xj.](t), 
Xj+|(t),  ...  xj^jt  t ) is  defined  by  (reference  5) 


|^j:  1 ,2  . . . j-1,  j+1 , . . . N|  = 1 ‘ l/[Sjj(w)S,J(uj)|  , 
where  S^M  is  thej th  diagonal  element  of  the  inverse  of  the  SXXM  matrix: 


(2.3) 


S-X'XM  = 


s1  ’m 

s12m  . 

..  s1MM 

S21(w) 

s22m  . 

..  s2Mm 

SM1M  sM2m  .. 


SMMM 


(2.4) 


Again  it  can  easily  be  seen  that  S"(  co ) is  real  and  that  S'^M  is  equal  to  sj'(oj)*.  The  multiple 
coherence  of  the  j th  sensor  with  respect  to  the  other  sensors  represents  the  proportion  of 
the  variance  (power)  of  sensor  j that  can  be  explained  by  a linear  combination  of  the  remain- 
ing sensors  in  a minimum  mean  square  sense  (reference  2). 

By  reducing  this  definition  to  the  simple  two-channel  case  we  can  write 


Sxx  (<■»>) 


S | | (uj)S->  t(oj)  - Sp(u) 


S')  ->(uj)  - S ] ->(lj) 
-S  | ->(u>)  S j j (u>) 


(2.5) 


so  that 


S1  1 (uj)  - S-)-|(uj)/|S|  j (uj)S-|  ->(uj)  - S|  -i(uj) 


“]• 


(2.6) 


This  gives 


"Vi . -)(uj) 


- = 1 - 1/fS,  ,MS'  *M] 

= I -|S||(i*;)S-)-)(uj)-jSj')((ja)|-i/S|j(uj)S-)  ->(ui) 


S | ->(u>) 


“/Si  | (cu)S-)')(u))  , 


(2.7) 


so  that 


Y| . -)M  ~ - Yi . | (w)  “ — Yj  s “ — 


S | -i(oj)  ~ 


S | j (uj)S  ")(u  ) 


(2.8) 


This  is  defined  in  section  3 as  the  mutual  or  pairwise  coherence  between  channels  one 
and  two. 
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In  the  three-channel  case  it  is  easily  seen  (writing  S:;(u;)  or  S::)  that  s'  *(uj)  is  given  by 


S1  'M 


s22s33  ' s23 


/DET. 


(2.9) 


Here  the  determinant  of  the  crosspower  spectral  matrix  is  given  by 


DET  — S i | S -> ->S3 3 - Sj  j S 3 3 1 ~ - S 3 3 |S 


33  2 1 1 


22  31 


+ 2Re(Sj  2S23S31  >■ 


(2.10) 


Using  this  expression  tor  the  first  diagonal  element  of  the  inverse  of  the  crosspower  spectral 
density  matrix  and  the  definition  of  the  multiple  coherence  (equation  2.3)  we  find 


Vj.3  ^ — 1-1  /( S j | MS ^ ^ (lo)  ) 


or 


l71:7 


1:2.  3| 


js22s33  -sn|s23|  -S33| 

S3  j|  “ - S 3 3 | S ^ j 

sns22s 

*33  'S1  1 1 s 2 3 1 “ 

_ l I 3 _ 1 I 3 _ _ 

S33  |S  ->  j | - + S s s | S3  j 1 " - 2 R e(  S j sS-i^S-^i  ) 

Sl  1 S22S33  's! I 

S23  2 

(2.1  1) 


(2.12) 


Using  the  fact  that  pairwise  coherence  is  defined  by 


I P Sii  ‘ 

v-  • r = — !J — 

i i.J  s s 
II  JJ 


(2.13) 


we  can  write 


lYl2i2+  |yi,3  I “ Rc  (3 1 2>23'>3 1 ’ 

1 * | "Y 2.3  |“  (2.14) 

Note  that  it  the  crosspower  spectral  density  of  channels  two  and  three  is  zero  (S-i^  - 0).  the 
coherence  between  these  two  channels  is  zero  and  the  multiple  coherence  of  channel  one. 
given  two  and  three,  is 

|Yj  3|“  = |Y|  s|-  + j V i 3!“.  (2.15) 


>3. 


: 2.3 1 
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We  know  that  |\  j 3!“  should  be  found  between  zero  and  one.  However,  this  is  not 
immediately  clear  from  equation  2.14.  particular,  when  | V 2 3 1 “ goes  to  one  the  denom- 
inator in  equation  2.14  goes  to  zero.  This  can  be  investigated  by  considering  the  case  when 
x-i(t)  is  generated  as  in  figure  2.1 : 

P 

x->(t)=  j x^la)  hs^ft  - o)do +u>(t) , (2.16) 

a 

where udt)  is  a zero  mean  stochastic  process  uncorrelated  with  x j ( t ) and  x-^(t).  In  this 
system  the  auto-  and  crosspower  spectral  densities  of  channel  two  can  be  written  as 

S-n(w)  = |ll  -ti(w)|-S33(ud  + W(w) 

Sj  l(oj)  = -^(w) 


(2.17) 


Note  that  if  W(^)  goes  to  zero  the  coherence  l,Y ->  -j|“  goes  to  one,  which  means  that  the 
denominator  in  equation  2.14  goes  to  zero.  To  investigate  this,  we  can  use  these  relation- 
ships (equation  2.1  7)  in  equation  2.14  to  give 

I,  |2  _ S33lH27(-)|2|S13|2  +<lH23(u,)hS33  +W)lS13p  -:lS13l"  S33lH23(^P 
r 1:2,  3)  ~ 7~ — TT j W~7 

SllS33[|H23(u,)rS33  + W1  ’S1  l|H23(u,)rS33 

I S 1 -)  I -w  Is  1 1 1 ~ I | -) 

= -U3j = I 131  = y,  J-  (2.18) 

S33S11W  S1 1 S33  ' K31 

Thus,  if  xil  t)  can  be  generated  by  passing  x^<  t)  through  an  arbitrary  linear  system  and 
adding  uncorrelated  noise,  then  no  new  information  is  gained  by  processing  the  time 
series  x ->(  t ) . 


Ill  is  result  is  independent  ofW(^)and  Vi  ^ 


(2.19) 


w(t) 

— & — 

Figure  2.1 . Generation  of  x ->( l ). 


*-  x2(t) 
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SECTION  3.0  PAIRWISE  COHERENCE  AND  SIGN  AL-TO-NOISE  RATIOS 

In  reference  5 the  ordinary  magnitude-squared  coherence  of  the  signals  xj(t).  xj(t)  is 
discussed  and  defined  as 

I n ISjjtco  )|~ 

lVi’-'l"“sijMSjjM'  <3'I) 

from  the  definition  of  coherence,  it  is  obvious  that  the  coherence  of  channel  i given  j is  the 
same  as  that  of  channel  j given  i. 

It  X|(t)and  xi( t)  are  generated  as  indicated  in  figure  1.3,  equation  1.1  can  be 
written  in  the  frequency  domain  by  Fourier  transform  as 

Xi(w)  = GjMUM  + V,M  (3.2) 

X:M  = C.->MUM  + V-.M.  (3.3) 

Again  assuming  the  noise  terms  V]  and  Vi  are  independent,  the  cross- and  autopower 
spectral  densities  can  be  written  as 


S,  I (co ) - 

|G]  (oj)  | - su(w)  + SV|  (uj) 

(3.4) 

Stt(uj)  = | 

Cj 2 ( co ) | - su(w)  + Svi(ui) 

(3.5) 

| S i 2<u>)  j - 

= |(r](u))|-  j C 1 2 ( co ) | - Su(ui)-. 

(3.6) 

Noting  that  |G](w)|-  Su(w)  and  |G2(w)  | - Su(uj)  are  the  output  signal  power  spectra  at  the 
receiver  in  channels  one  and  two,  we  write  the  magnitude-squared  coherence  as 


Y,  ->  - = 


G|(oj)  - Gs(w)  j - S1((uj)- 

G](oj)  - Su(co)  + SV|  (uj)  Cmlcj)  j - SU(U)  + Sv-,(u>)l 


1 I ^ 

1 

r i ,2 1 ~ 

1 + SVjfw)/  | G 1 (co) 

2 Su(w) 

1 1 + SVt(u >)/ 1 < ; 2<co > 

2S„(u)) 

Defining  the  signal-to-noise  power  in  the  )lh  channel 
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and  the  similar  noise-to-signal  ratio  as 
(N/S)j  = 1 /( S/N  )j , 

we  can  write 


(3.10) 


'1,2 


1 


S 
N I] 


S) 

N h 


11  + (N/S)|  1 II  + ( N/S>2 1 


1 + 


IN/] 


1 + 


'SI 

»NJ 


(3.1 1 ) 


Certain  general  statements  concerning  this  pairwise  magnitude-squared  coherence,  or 
just  “coherence,”  can  now  be  made. 

The  coherence  is  bounded  between  zero  and  one: 


0 <|y  I < 1.  (3.12) 

f the  noise-to-signal  power  goes  to  infinity  in  either  channel,  the  coherence  will  go 


to  zero.  This  will  happen  if  the  signal  power  in  that  channel  lades  to  zero.  Also,  the  noise- 
to-signal  power  ratio  in  both  channel-  must  go  to  zero  for  the  coherence  to  go  to  one. 

An  interesting  and  informative  interpretation  of  the  coherence  between  these  two 
channels  can  be  made  in  the  following  manner.  Assume  one  ol  the  channels  is  noise  free: 


Svi(w)  = 0. 


(3.13) 


This  channel  then  becomes  the  input  signal.  The  coherence  between  channels  one  and  two 
is  now  uiven  by 


C.|(ud|-SUM  <I * * * S/N>1  =_  S]_ 


< . 1 (ou)  -SUM  + sv.  (to)  1 + (S|/N)1  Sl+Nl 


(3.14) 


I his  maeniluile-squared  coherence  is  the  traction  ol  the  power  ol  the  output  \|(t) 
which  comes  from  the  signal  input  passed  through  a linear  system. 

Since  the  tr  msmitted  signal  is  generally  not  available,  it  is  useful  to  look  at  this 

physical  interpretation  ol  coherence  Irotn  a dilterent  point  ot  view.  Let  us  simply  take 

signal  \ ->(  l ) as  our  basic  signal  and  calculate  the  coherence  between  xj  (t)  and  our  given 

signal  x s(  I ) I rom  equation  3 I . our  del inition.  this  will  be  the  same  result  as  it  we  took 
signal  x | ( t ) as  our  "given”  signal.  I Inis  ll(oj)  in  equation  3.2  is  replaced  by  Xs(co): 


X j (co)  = H [ 2(w)X2(wO  + Vep(w). 


(3.15) 


Hi  ->(uj)  is  the  effective  linear  transfer  function  between  output  x->(t)  and  output  x j ( t ). 

V,  (t)  is  the  effective  noise  on  the  transmission  channel.  It  must  be  noted  that  Hi  ->(w)  is 
ep  ■ - 

no  longer  necessarily  a causal  system.  Now  the  coherence  between  channels  one  and  two 

can  be  written  as  in  equation  3.14: 


Y1,2(uj)  “ = f7 


H ] 2(w)  -S->2(cj) 


H 1 2(co) | -S2 2(°J)  + ^vei 


This  two-channel  magnitude-squared  coherence  is  the  ratio  of  the  power  at  output  X](t). 
which  is  caused  by  the  “input  X2<t),”  transmitted  over  the  effective  linear  transmission 
channel  [Hj2(w)1  to  the  total  power  in  output  xp  Consideration  of  this  effective  linear 
transmission  channel  allows  this  physical  interpretation  of  the  coherence  to  be  easily  carried 
over  to  multiple  coherence. 


SECTION  4.0  MULTIPLE  COHERENCE  AND  SIGNAL  TO-NOISE  R ATIOS 


In  the  ease  of  M channels,  a relationship  between  the  input  signal-to-noisc  ratios  and 
the  multiple  coherence,  similar  to  the  one  in  the  last  section  for  two  channels,  can  he  derived. 
The  output  power  spectral  density  can  again  he  written  in  terms  of  this  input  signal  spectral 
density,  the  unknown  channel  transfer  functions,  and  the  effective  channel  noise  as 


S;;(c~>)  = G;(w)  -S, ,(>  ) + Sv.(w) 


Sjj(w)  - = Gj(w)| - GiM  ~S,,M~.  i^j 


(4.1 ) 


(4.2) 


It  should  be  noted  that  |Cij(w)|-Su(oo)  is  the  signal  power  density  in  the  output  of  the  i ill 
cliannel  and  Sv.(co)  is  the  noise  power  spectral  density  in  that  channel.  The  general  power 
spectral  density  function  can  then  be  written  as 


C i j ( oj ) S^j(d)  + Sy  (k>)  Ci  j (lo)Cj  ">(w)S^(  w) 


( i ■> ( oj )C i j (w)Su(w) 


(l->(vx^)  “Sm(uj)  + Sv  (uj) 

_ U V *■> 


( 1 | ( Uz  )C  i ( uJ  ) S U/  ) 


( | ■>(  )(  I t^j(  )S^(  w) 


( i^(oj)C  i j (u>)S^(u>)  Cj  j^j(u>)(i  ~»(u>)S^(uj) 


|(iM(w)rSu,uj)  + SvM,-‘j 


(4.3) 


or  m a more  concise  manner  as 


sx  x(u>)  = Sl((w)( ; (w)(i ' (u>)  + i)(w), 


(4.4) 


where 
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. . 0 


DM  = 


Sv  M 0 


0 Sy?(co)  ...  0 


0 0 


and 


G (u>)  — |G  | MGtM  ■ ■ • 


The  inverse  required  to  calculate  the  multiple  coherence  from  equation  2.3 
culated  by  using  the  following  matrix  inversion  lemma: 

|,\  + X*XT|-'  = A-'  - A-1  X*  (l  + XT  V1  X*)-'  XTA-> . 

Using  this  lemma,  the  inverse  of  the  spectral  density  matrix  can  be 
all  required  inverses  exist)  as 


S-X'XM  = D->M 

-Su(w)D''(w)G*(w)  jl  + Su(w)GT(w)D''(w)G*M| 
The  structure  of  this  inverse  can  be  seen  more  clearly  by  noting  that 


Su(co)G^(w)D"*  MG*M 


G|(w)  "Su(w) 


SV,M 


G-.M  “S..M 
+ — = — + 


G^M  ~SUM 

s«m(u) 


This  term  is  the  sum  of  all  output  signal-to-noise  power  ratios.  Therefore, 
channel  case,  we  define 


(S/N)j  = Gj(co)  ~SUM/SV.M 


the  inverse  of  the  bracketed  term  in  equation  4.8  can  be  written  as 


I + SuMGTMD-'(w)G*(u) 


M 

1/  1 + L (S/N): 
j=l 


(4.5) 

(4.6) 

i can  now  be  cal- 

(4.7) 

written  (assuming 

(4.8) 

■'gJmd-'m. 


(4.9) 

if,  as  in  the  two- 

(4.10) 

(4.1  1) 
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With  this,  the  \th  diagonal  element  of  S“  (cj)  is  given  by 


|s'x’x(w)|||  = S''(w) 


SV.M 


GjM  -Su(w)/S-.(w) 


+ E (S/N)j 


1 <S/N>i 

S.,(w)  M 


1 + E (S/N): 
j=l 


Sv  < OJ) 
vi 


+ E (S/N):  -(S/N): 

i=l  

M 

I + £ (S/N): 
j=l 


Using  litis  anil  substituting  equation  4.1  into  equation  2.3,  we  find 


hi/1,2,  . . . i-l , i+1 , . . . m|~  = I - l/fSjjMS'ku)) 


E (S/N): 


I + ( S/N )j  I + E (S/N)j  - < S/N )j 


7 M \ 

( S/N ) j j Y ( S/N  )j ) - ( S/N ) j 

l\j=l  / J__ 

/ M \ 

I + ( S/N )j  nf£  (S/NDj  1 - (S/N>j 


Several  special  cases  are  of  interest. 

f irst  consider  the  situation  in  which  the  signal-to-noise  ratios  in  all  channels  arc  the 


This  gives  the  coherence  of  channel  i with  respect  to  the  other  M-l  channels  as 


i:1.2 i - l,i+  1, 


M 2 = 


(S/N)~  (M-l ) 


[1  + ( S/N)  1 [ 1 + (M-l  )f S/N) ] 


(4.16) 


Note  that  for  M equal  to  two  as  in  section  3 the  coherence  is  given  by 


' 1 :2 


= 7 


2:1 


(S/N)2 
(1  + (S/N)) 2 


However,  if  M becomes  very  large,  the  coherence  goes  to 


' i:  1 ,2 i - 1 , i + 


M 


S/N 


1 + ( S/N ) 1 


(4.17) 


(4.18) 


The  formal  requirement  for  this  to  be  valid  is  for  the  signal-to-noise  ratio  and  number  of 
channels  to  satisfy  the  following  inequality: 

(M-l )( S/N ) » I . (4.19) 


However,  based  on  data  from  section  3.  equation  4.18  is  identical  to  the  coherence  of  two 
channels  when  one  has  an  infinite  signal-to-noise  ratio  and  the  other  has  a signal-to-noise 
ratio  (at  frequency  w)  of  (S/N).  In  this  sense,  a large  enough  number  of  weak  channels 
Isignal-to-noisc  ratio  of  < S/N ) ] is  equivalent  to  the  sum  of  one  noise-free  channel  and  one 
weak  channel. 

The  second  special  case  for  equation  4.14  is  when  the  i ill  channel  has  a very  large 
signal-to-noise  ratio.  Letting  (S/N)j  become  large  in  equation  4.14  and  keeping  all  other 
signal-to-noise  ratios  equal  to  (S/N)  we  find  that 


|2  (M-l )( S/N) 

(S/N)p=°  1 1 + < M-l  )(S/N)|  ‘ 


(4.20) 


Note  that  for  low  signal-to-noise  ratios.  /.<>., 

( M-l  XS/N)  « 1 , (4.21) 

the  coherence  goes  up  linearly  with  the  number  of  channels.  Fiach  new  channel  added  is 
also  considered  to  have  the  same  signal-to-noise  ratio  as  all  others,  i.c.,  (S/N).  As  M becomes 
larger  or  as 


NKS/N)  » 1, 


(4.22) 


this  coherence  goes  to  one  as  it  would  in  the  case  of  two  noise-free  channels. 


1 he  relationships  between  signal-to-noise  ratios  and  coherence  tor  these  two  cases 
are  in  table  4.1.  Note  that  as  expected  the  signal-to-noise  ratio  required  in  each  channel  to 
obtain  a given  coherence  declines  with  an  increasing  number  of  channels  and  increases  with 
an  increased  level  in  the  specified  coherence. 

Table  4.1.  Signal-to-Noise  Power  Ratios. 


Signal-to-Noise  Power  Ratios  Required  to  Yield  Indicated 

l7h  Value  When  All  Input  Channels  Have  I qual  Signal-to- 

......  ^ , Noise  Ratios 

M = Number 

of  Channels 


0.01 

0.05 

0.1 

0 111 
-4.5  dB 

0.288 
-5.4  dB 

0.462 
-3.3  dB 

0.074 
-1  1.0  dB 

0.206 
-6.4  dB 

0.333 
-4.4  dB 

0.065 
-1  1.4  dB 

0.172 
-7.6  dB 

0.2X0 
-5.5  dB 

0.057 
-12.4  dB 

0.152 
-8.18  dB 

0.250 
4x0  dB 

0.040 
-14.0  dB 

0.1  1 1 
-4.55  dB 

0.184 
-7.2  dB 

0.016 
-18.0  dB 

0.060 
-12.2  dB 

0.121 
-4.17  dB 

0.83  dB 
0.8X5 
-0.5  dB 


0.760 
-1 .2  dB 


0.641 
-1.6  dB 


2.5  dB 


0.443 
-3.5  dB 


I 3.8  dB 


1.78 
2.5  dB 


1 .55 
1 .4  dB 


1.42 
1.52  dB 


0.74  dB 


1.02 
0.04  dB 


18.5 
I 2.6  dB 


13.8 
1 1.4  dB 


12.2 

10.4  dB 


1 1.4 
10.6  dB 


10.1 

10.0  dB 


4.10 
9.6  dB 


Signal-to-Noise  Power  Ratios  Required  to  Yield  Indicated  iyr 
Value  When  uh  Channel  Has  Infinite  Signal-to-Noise  Ratio  and 


M = Number 
of  Channels 


M = 100 


0.01 

0.05 

0.1 

0.010 
-20.0  dB 

0.053 
-12.8  dB 

0.1  1 1 
-4.6  dB 

0.005 
-23.0  dB 

0.026 
-15.4  dB 

0.056 
-12.5  dB 

0.003 
-25.2  dB 

0.017 
-17.7  dB 

0.037 
-14.3  dB 

0.002 
-27.0  dB 

Emu 

0.028 
-15.5  dB 

0.001 
-30.0  dB 

0.012 
-14.2  dB 

0.0001 
-40.0  dB 

0.0005 
-33.0  dB 

0.001  1 
-24.6  dB 
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0.214 
-6.7  dB 


1.00 
0.0  dB 


0.5 

-3.0  dB 


8.5  dB  -4.8  dB 


4.7  dB  I -6.0  dB 


0.048  0.111 

-13.2  dB  -4.8  dB 


0.0043  0.0101 

-23.7  dB  -20.0  dB 


,0C 

.5 


.5 

.5  dB 


3.0 

4.8 


2.25 
3.5  dB 


-10.4  dB 


Next  consider  the  case  where  one  channel  other  than  the  Uh  channel  has  a ver\  high 
signal-to-noise  ratio  relative  to  the  others: 


<S/N)k  »£  (S/N):  -(S/Nlj  -<S/N)k. 


Under  these  conditions,  equation  4.14  is  approximately  given  by 


7 


i:  1 ,2, 


i-1,  i+1, . 


(S/N)j(S/N)k 
[1  + (S/N)j]  [ 1 + (S/N)k  1 


(4.24) 


or 


hi:  1 ,2 i-1, i+1,.  . . Nil"  ~hi:k|2’  <4-25) 

as  it'  all  other  channels  were  not  used.  If  (S/N)j  is  approximately  equal  to  (S/N)k,  this  means 
that  all  weaker  channels  could  be  neglected  and  only  the  two-channel  coherence  between 
the  two  stronger  channels  could  be  used.  Also  consider  the  case  when  ail  channels  including 
the  i th  have  a much  lower  signal-to-noise  ratio  than  the  k th  channel,  i.e.. 

(S/N)k  » (S/N)j  = (S/N)  all  i^k  (4.26) 


Then,  while  the  coherence  of  the  \th  channel  given  the  others  is  provided  by  equation  4.24, 
the  coherence  of  the  k th  channel  given  the  others  is 


2 

,2 k-l  ,k+l M 


( M—  1 )(S/N)k(  S/N) 

[1  + (S/N )k ) 1 1 + (M-l  )(S/N)) 


(4.27) 


(4.31) 


b 


r k:  1 ,2 k-l.k+l M ~(M",)'1'i:k 


The  coherence  between  the  strong  signal  and  the  weaker  ones  goes  up  linearly  with  the  num- 
ber of  weaker  channels.  This  means  that  the  largest  of  the  M multiple  coherence  values  will 
be  the  one  in  which  the  largest  signal-to-noise  ratio  channel  is  used  as  the  reference,  which  is 
as  expected. 
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SECTION  5.0  A SAMPLE  STATISTIC  FOR  MULTIPLE  COHERENCE 


As  in  the  ease  of  pairwise  coherence  discussed  in  section  3.  the  true  multiple 
coherence  of  a set  of  time  series  is  a function  of  the  underlying  statistics  of  these  processes. 
These  statistics  are  generally  unknown  and  must  be  estimated  from  sample  realizations  of 
the  processes.  The  estimates  of  the  basic  statistics  can  then  be  used  to  provide  estimates  of 
the  multiple  coherence  of  the  M underlying  stochastic  processes. 

The  method  of  obtaining  estimates  for  true  multiple  coherence  is  as  follows.  Using 
well  documented  techniques  (see  references  3,  4,  5,  and  6),  obtain  sample  estimates  for  each 
element  of  the  crosspower  spectral  density  matrix  (equation  2.1 ).  From  these  sample 


estimates 

Sj  |M 

A 

Sj2(w)  . . 

slM(w) 

h x(w)  = 

A 

St  ] (w) 

§22(w)  ■ • 

A 

S2m((a>) 

(5.1) 

sm,m 

S[y|2(w)  • • 

Smm(w) 

one  calculates  the  sample  estimate  for  multiple  coherence  in  the  following  manner 


l^i:  1,2,  . . . ,j-l,j+l,  . . . m|2  = 1 - l/lSjiMS'V)],  (5.2) 

Aii 

where  S^aw)  is  the  tlh  diagonal  element  of  the  inverse  of  the  M-by-M  sample  spectral  density 
matrix  Sxx(u).  Details  of  how  to  form  such  estimates  are  discussed  at  length  in  the  litera- 
ture. Since  these  estimates  are  random  variables  there  has  been  considerable  study  of  their 
distribution.  The  distributions  of  these  cross-  and  autopower  spectral  estimates  are  known 
in  closed  form  and  are  given  in  reference  7. 
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SECTION  6.0  DISTRIBUTION  OF  SAMPLE  STATISTICS 


As  it  is  for  the  pairwise  coherence  discussed  in  reference  X.  the  closed-form  expres- 
sion for  the  multiple-coherence  statistic  described  in  the  last  section  is  available  (references 
7,  X,  and  0).  This  represents  the  range  of  values  of  the  multiple-coherence  test  statistic  and 
the  relative  probability  of  its  being  in  a particular  band.  All  values  are  of  course  bounded  by 
zero  and  one.  The  density  function  is  conditioned  on  the  total  number  of  different  time 
records,  or  different  stochastic  processes,  available  (p).  It  is  also  conditioned  on  the  number 
of  independent  complex  samples  available  from  each  of  the  time  records  ( N ) at  a given  fre- 
quency vv.  Thus  from  reference  9 the  density  function  of  the  sample  estimate  for  coherence 
given  the  true  coherence  is  given  by 


P (y/N.p.M2) 

M- 


T(N) 

rtp  - i m'N  - p+i  t 


(l  -M:)  N yl1"2  (1 


- y) 


N-p 


■ sE|  (N.N.p-l  : y|7l2) 
0 < y < 1 


P (y/N,  p,|'y|~)  = 0 y > I or  y < 0. 

M- 


In  equation  6.1,  ->  I - 1 ( ) is  the  hypergeometric  function  (reference  10). 

This  expression  for  the  density  function  of  multiple  coherence  is  both  expensive  to 
calculate  and  generally  numerically  ill  conditioned.  Thus  to  evaluate  the  density  numerically, 
additional  manipulations  are  required,  (beat  difficulty  can  v encountered  in  attempting  to 
use  computer  library  expressions  for  the  hypergeometric  function. 

For  low  values  of  N and  p we  can  use  a transformation  given  in  reference  I 2: 

2 F | ( N , N.  p-l  ;M2y) 

= (l  — ] T I ~ y ) 1 — - IN  _N,  p-|-N,  p-l  ; |-y  I “ \ ).  (6.2) 


For  the  eases  of  interest,  (p-l-N)  is  a negative  integer  so  that  a finite  series  expan- 
sion for  this  latter  hypergeometric  function  is  available: 


2d 


(6.3 


->F  ] ( N.  N.  p-1 ; j"y i“y ) 


where 


.n-hl2y)p-‘-2N 


N-PJI  l-N+p-l )?  ,jT|2y)j 
,48  (P-i  *j  j-  ' 


(p-1  )j  = (p+j-1 )!/( p-1 )!  = (p+j-2)(p+j-3) . . . (p-1 ) (6.4 

(-N+p-l  )j  = (-N+p-1  )(-N+p)  . . . (-N+p-2+j).  (6.5 


Using  these  expressions  for  the  hypergeometric  function  we  can  write  for  y between  zero 
and  one: 


•V-n  (y/N.p.lt  i:> 
M- 


_r(N)(  i-hl~)N 
r(P-i  m n -p+i  i 


yP-2,1—  y)N-P 

< ! -h  |-y  )-N-<p-i  > 


N-(P-I)  ,-Nt(p-l)|j  (|Tpy>i 

its  'J  i! 


An  alternative  expression  can  be  derived  by  using  the  relationship  between  hypergeometric 
functions  and  Jacobi  polynomials.  Thus, 

pn  A *)  = (n  ^ °)(— y— j*1  2F!  (-n’  -n+'°+l : xTl)  l<UI 

(from  reference  I 2).  Using  this  identity  and  letting 


P =0 


o = p-2 
n = N-(  p-1  ) 

(x-li/(x+l)=  |vpyorx  = (l  + |v|-y)/<  l — |v|“y)-  (6.8) 


sl'|(p-N-l , p-N-l . p-1  :l7hy) 


<l-bi:y)N-,p-|) 

I N_1  ) 

\ N— < P—1  )| 


pC3p-i)l(1+  M2y)/(1-M2y)l. 


(6. 


we  have 


1 


Using  t ho  iienoral  expansion  for  t ho  Jacobi  polynomial 


l>°.P(x,  _ l (o  +n+ 1 ) y,  /n  tHo- +(3+n-nn+ 1 )/x-l\m 

11  n!r(a+p+n+l  ) " \m/  ria+m+l ) \ 2/ 
m=0 


we  find  that 


'n-P+I  I < 1 + V 2y ) < ! - V -y ) | 


. ■ ST'( 

N-(  p-1  ) 

\ r(N+m) 

Y 2y 

IN-.p-ni:  Z() 

m 

/ r(m+p-l  ) 

1-  Y 2y 

so  that  another  general  expression  lor  this  conditional  density  of  the  coherence  is 

I’ ,y  |N.p.  I Y|- , = HMl 

)y|-  1 1 1 1 1 ~y  I y | ~ 

N ii,’  11  / N-p+ 1 \ ( N+iii-l  )l  ( |V  |~y  t 111 
„~0  1 m I tn+p-2)'.  I < i — ] “V  | — y > 

When  true  coherence  is  zero  this  reduces  to 

i- (y  I n.,i.  |yp,ni.y|'~:<'-y'N-p'S-ir 

|v|-  ( P-J  >!(  N-p)l 

and  lor  t wo  channels  to 


P <y  |\.p=:.  |y|-  = 0)  = (N-l  )(  l-y)N-:. 

I y|~  ' 


(6.  1 0 ) 


(6. 1 I I 


(h.l  2l 


(d.131 


((i.l4l 


lo  caleula'e  receiver  operating  characteristics  it  is  necessary  to  evaluate  integrals  of  these 
densities.  I o do  this  analytically,  we  expand  the  term  ( |-y)N-p 


( y 

Np  |y|-,  = 

(l-M-)N 

M-  ' 

( N-p)! 

Ki.15) 


N-<  p- 1 ) 

z 

111  =0 


/ N-p+ 1 > 

| ( N + iii-l  )!  |v| 

' m ) 

( m+p-2 )! 

2,11  hl/N-p\  yin+j+p-2 

l j 'u-M-y»NH 


; )N+m 
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/(M-L-j+1)  (6.16) 


so  that  the  distribution  function  of  the  estimate  for  the  coherence  can  be  written  as 


F- — _ (y  | N,p.  |v|-)  = / P- — _ (r|N,p.  j Yp)dr 
V 2 ' t I Y I — 1 


(6.17) 


(1 


_iy|2>n  NHp-l),  N-p 


(N-p)! 


y f-P-'ly  ,-u)/  N-p) L_ 

i^o 1 ' j 'M2(j+p-' 


s=0 


(-N+j+p-l-s) 


(i  - ivi2yrN+-'+p",-s 


(6.18) 


which  will  be  numerically  well  behaved  for  (large)  values  of  Y - greater  than  -me-half. 
Interchanging  the  order  of  summation,  this  can  be  written  as 


i — (y|N,P.  lv|2)  = 


1 ) 

f i-IyP  1 

N 

1 

.I-Iy  ~y. 

(N-p)!  | 

Yp(P-' ' 

y (r^)P.S  |(1-  | Ypy)s  - ( 1 - |\|~y)N[  . (6. 1 c)) 

s=p-N 


N-(  p- 1 ) 

E 


m=.MAX(0, 


(nT")e 


=MAX((),s+ 1 -p) 


(Nr)(;C'T-s:),M:r 


where  tor  given  values  of  N,  p.  and  | Y 1 “ the  last  two  sums  can  be  evah.at  -d  independently  of 
y.  I hese  values  can  then  be  stored  to  greatly  reduce  the  computation  required  to  evaluate 
additional  integral  values  for  the  same  values  of  N.  p,  and  I Y j — . 

An  expression  which  can  be  used  for  small  values  of  | Y | — can  be  obtained  by  expand- 
ing the  term  ( I-  |Y|-y)'*-  in  equation  6.16  to  obtain 


26 


I 


The  density  functions  of  the  sample  statistic  for  coherence  when  the  true 
coherence  is  zero,  the  Hq  hypothesis  case,  are  shown  in  figure  6.1  for  a number  of  degrees 
of  freedom  (N)  from  1 to  2048.  For  N greater  than  8,  densities  for  the  number  of  sensors 
(p)  equal  to  2.  3,  4.  5.  and  10  are  indicated. 

Figures  0.2  through  6. 1 2 show  density  functions  for  a given  number  of  degrees 
of  freedom  ( N)  and  a given  number  of  channels  ( p).  The  density  functions  of  the  sample 
statistic  for  coherence  for  the  stated  values  of  N and  p and  for  true  coherence  of  0.0.  0.05. 
0. 1 . 0.3  and  0.9  are  given. 

Based  on  these  data  it  is  possible  to  calculate  the  performance  curves  for  the 
multiple-coherence  statistic  as  a detection  test  statistic.  This  procedure  is  well  documented 
in  a number  of  textbooks  (references  13.  14,  and  15).  Basically,  these  performance  curves 
are  developed  in  the  following  manner.  For  a given  level  of  true  multiple  coherence  |'y|  — , 
number  of  degrees  of  freedom,  and  number  of  channels,  one  defines  two  hypotheses,  Hq 
and  H].  Hypothesis  Hq  is  that  there  is  no  causality  between  the  referenced  channel  and  the 
other  channels  and  thus  the  coherence  is  zero.  Hypothesis  Hi  is  that  there  is  a causal  rela- 
tionship  between  the  channels  (time  series)  and  thus  the  true  multiple  coherence  is  lyl~. 

For  a given  threshold  (a),  hypothesis  Hq  is  chosen  if  the  sample  value  of  the  multiple- 
coherence  statistic  is  below  a and  Hj  is  chosen  if  the  sample  value  of  the  statistic  is  above  a. 
The  probability  that  Hj  is  selected  when  Hq  is  true  is  the  probability  of  false  alarm  (Pp^): 


’FA  (a)  = f 
•'a 


P i (y/l'yh  = 0,  N.  p)  dy. 
I7l" 


The  probability  that  H|  is  selected  when  Hj  is  valid  is  the  probability  of  detection  iPppjP 


P|)FT(a)  = / P|7j2  N,  p)  dy. 

■Ja. 

For  each  value  of  N and  p we  can  plot  Pppyla)  as  a function  of  Pp^tor).  since 
a runs  from  0 to  I . These  curves  are  in  figures  6. 1 3 through  6. 1 8 for  N of  32.  64.  1 28.  5 1 2. 
and  1 024;  parts  a through  e correspond  to  the  number  of  channels.  Curves  for  several  values 
of  true  coherence  are  indicated. 

The  difficulty  with  these  classical  performance  curves  is  that  they  are  linear  in 
probability  of  false  alarm  and  therefore  do  not  properly  illustrate  low  values  for  this  param- 
eter. Ibis  is  alleviated  by  plotting  the  same  data  with  a log  scale  used  as  the  probability  of 
false  alarm  (figures  6.19  through  6.24). 

In  using  multiple  coherence  as  a detection  test  statistic,  the  value  for  true 
coherence  is  not  generally  known.  Thus  it  is  of  interest  to  determine  how  the  probability 
of  detection  varies  for  a fixed  value  for  probability  of  false  alarm.  This  can  be  determined 
from  figures  6. 1 9 through  6.24  by  selecting  a given  probability  of  false  alarm  and  drawing  a 
vertical  line  from  which  the  probability  of  detection  as  a function  of  true  coherence  can  be 
determined. 

Plots  for  probability  of  detection  as  a function  of  true  coherence  tor  values  for 
probability  of  false  alarm  t 10“'  to  IO-(’)  are  in  figures  6.25  through  6.30. 


28 


(v/h'l2-0.N-4.p)  _ P ,<y/l-|rP -O.N 


29 


cr 


Figure  6.2.  Density  function  for  2 degrees  of 
freedom  (N)  and  2 channels  (p). 


Figure  6.3.  Density  functions  for  4 degrees 
of  freedom  (N). 
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Figure  6.4.  Density  functions  for  8 degrees  of  freedom  (N). 


; 


■ 


/ 


ca_ 

£• 


«>L 


O 

6 


c*_ 


\ 

( 


II  <*_ 

ql  _£r 

\x 


JX  r* 


‘ Z 

z 

< 

X 

o 

IL 

>o 

X 

UJ 

CD 

s 

D 

Z 

6 • 

h-  * 

X •' 

< a. 


1 1^1 

**»*xe  *n  *z|iC| /a» d 


< 

i 

o 

u. 

>o 

X 

Ui 

CD 

5 

D 

Z 


X " 

5 a 


z 

z 

< 

X 

o 

LL 

>o 

X 

UJ 

OD 

2 

D 

z 


X 11 

? a 


oti  rat  j'k  o-w  btI  n vo 

z 1^1 

(01  *d'2C  - N *2|4,|/a) d 


- B :'«r  lit  OV  iv  CTI  r.  » 

(S-<«-tC.N-zH|/A) d 


35 


PART  D.  NUMBER  OF  CHANNELS  PARTE  NUMBER  OF  CHANNELS 

Ip)  = 5.  (P)  = 10. 


m rtii  o*b  j » 

(C  «'8Zl 


37 


Kigurc  6.8.  Density  function  for  1 28  degrees  of  freedom  (N). 
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Figure  6.14.  Linear  receiver  operating  characteristics:  performance  curves  for  the  multiple-coherence  test  statistic 
Number  of  degrees  of  freedom  (M  = 64. 


Figure  6.1 5.  Linear  receiver  operating  characteristics:  performance  curves  for  the  multiple-coherence  test  statistic. 
Number  of  degrees  of  freedom  (N)  = 1 28. 


45 


f igure  6.16.  Linear  receiver  operating  characteristics:  performance  curves  for  the  multiple-coherence  test  statistic. 
Number  of  degrees  of  freedom  (N)  = 256. 


Figure  6.17.  Linear  receiver  operating  characteristics:  performance  curves  for  the  multiple-coherence  test  statistic. 
Number  of  degrees  of  freedom  (N)  = 512. 
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Figure  6. IS.  Linear  receiver  operating  characteristics:  performance  curves  for  the  multiple-coherence  test  statistic. 
Number  of  degrees  of  freedom  (N)  = 1024. 
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PART  D.  NUMBER  OF  CHANNELS  (p)  - 5.  PARTE.  NUMBER  OF  CHANNELS  (p)  = 10. 

Figure  6.21 . Semilog  receiver  operating  characteristics:  performance  curves  for  the  multiple-coherence  test  statistic. 
Number  of  degrees  of  freedom  (N)  = 1 28. 
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PART  D.  NUMBER  OF  CHANNELS  <p)  * 5.  PART  E.  NUMBER  OF  CHANNELS  (p)  * 10. 

Figure  6.24.  Semilog  receiver  operating  characteristics:  performance  curves  for  the  multiple-coherence  lest  statistic. 
Number  of  degrees  of  freedom  ( N ) = 1024. 
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Figure  6.25.  Probability  of  detection  as  a function  of  10  log|  q (true  coherence)  for  the 
multiple-coherence  test  statistic.  Number  of  degrees  of  freedom  (N)  = 32. 
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Figure  6.26.  Probability  of  detection  as  a function  of  10  log|Q  (true  coherence)  for  the 
multiple-coherence  test  statistic.  Number  of  degrees  of  freedom  (N)  = 64. 
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Figure  6.28.  Probability  of  detection  as  a function  of  10  log  |q  4 true  coherence)  for  the 
multiple-coherence  test  statistic.  Number  of  degrees  of  freedom  (N)  = 256. 
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Figure  6.30.  Probability  of  detection  as  a function  of  10  log.gttrue  coherence)  for  the 
multiple-coherence  lest  statistic.  Number  of  degrees  of  freedom  (N)  = 1024. 
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